NASA Contractor Report 158997 


NASA-CR-158997 

00 Q 210^ 


Experimental and Simulation Study 
Results for Video Landmark Acquisition 
and Tracking Technology 


Roger T. Schappell, John C. Tietz, 

H. Michael Thomas, and James W. Lowrie 


MARTIN MARIETTA CORPORATION 
Denver, Colorado 80201 


Contract No. NASl-14489 
February 1979 


NASA 

National Aeronautics and 
Space Administration 

Langley Research Center 

Hampton, Virginia 23665 
AC 804 827-3966 



LAK'CLE'^ _ ^^^,TER 

u r ” .C' 

Hampioini, VIRLINIA 



NF01318 



FOREWORD 


This report presents the experimental and simulation study results 
for Video Landmark Acquisition and Tracking Technology applicable 
to future global monitoring systems. During this study, a number 
of related technology areas were investigated and are summerized 
herein. Earlier work performed during the first six months of the 
contract was reported in Preliminary Experiment definition for 
Video Landmark Acquisition and Tracking^ NAS CR-145122, December 
1976, by Schappell, Tietz, and Hulstrom. 
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I. 


INTRODUCTION 


Studies relating to Earth and stellar exploration programs have 
pointed out the need for adaptive real-time observation systems 
capable of detection, acquisition, pointing, and tracking with 
respect to the observable of interest, with emphasis on autonomous 
operation. 

This report provides a synopsis of related Earth observation tech- 
nology that was developed, breadboarded, and tested under contract 
to NASA and includes surface-feature tracking, generic feature 
classification and landmark identification, and navigation by 
multicolor correlation. 

With the advent of the Space Shuttle era, the NASA role takes on 
new significance in that one can now conceive of dedicated Earth 
resources missions. Space Shuttle will also provide a unique test 
bed for evaluating advanced sensor technology like that described 
in this report. As a result of this type of rationale, the FILE 
OSTA-1 Shuttle experiment, which grew out of the Video Landmark 
Acquisition and Tracking (VILAT) activity, was developed and is 
described in this report along with the relevant tradeoffs. In 
addition, a synopsis of FILE computer simulation activity is in- 
cluded. This synopsis relates to future required capabilities 
such as landmark registration, reacquisition, and tracking. 

Many tasks have been performed under this contract. Though they all 
relate to landmark identification and tracking, they are not closely 
related and are therefore presented in five separate chapters. 

Chapter II deals with the Feature Identification and Location 
Experiment (FILE), which was defined under this contract. FILE 
hardware is being built, with the Intent of flying it on STS-2 or 
-3. 


Chapter III summarizes the results of a number of largely inde- 
pendent tradeoff studies performed in the definition of the FILE. 
These tradeoffs were required to select certain major system com- 
ponents . 

Chapter IV reports the results of a number of FILE system per- 
formance analyses, including target signature analyses; determina- 
tion of the effects of camera noise, viewing angles, atmospheric 
effects, position in orbit, and "beta" angles; estimation of system 
error rate; and an analysis of data acquired as a function of time. 
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Chapter V describes a unique approach to video landmark acquisition 
and tracking, and contains a summary of analyses and experiments 
conducted to estimate the performance of a system based on this 
approach. It also describes a hardware system to locate and track 
landmarks by means of the principles described. Such an instrument 
IS recommended as an advanced Feature Identification and Location 
Experiment to be flown aboard the Space Shuttle. Chapter VI reports 
the results of experiments performed by Martin Marietta's image pro- 
cessing facility to test concepts for eventual incorporation in an 
advanced FILE instrument. 
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II. 


FEATURE IDENTIFICATION AND LOCATION EXPERIMENT (FILE) 


The FILE goal is to test a technique for classifying picture el- 
ements in a television picture of the Earth as vegetation, bare 
land, water, or clouds and snow. Classification will be auto- 
omous and in real time by a small instrument. The technique 
uses simple circuitry that is adaptable to a variety of appli- 
cations and requires no computational capability. The experiment 
also tests the ability of the instrument to make appropriate 
real-time acquisition decisions based on scene contents. 


A. PRINCIPLE OF OPERATION 


The FILE system classifies on a picture-element-by-picture-element 
basis. Each element is classifxed by its spectral signature 
alone. No pattern recognition is required. Computer simulations 
and field measurements have confirmed that the four basic feature 
types — vegetation, bare land, water, and clouds or snow — can be 
separated by radiance measurements at two discrete wavelengths: 

650 and 850 nanometers. The former wavelength is in the chlorophyll 
absorbtion band, in which healthy green vegetation has very low 
reflectance. At this wavelength, water has significant reflectance; 
and bare land, snow and clouds have even higher reflectance. Eight 
hundred fifty nanometers is in the near infrared, where healthy 
green vegetation has a very high reflectance, as do clouds, snow, 
and bare land, while water has extremely low reflectance, as 
illustrated in Figure 1. 

Observed radiance from an object is a function of the object's 
reflectance and incident illumination, as V7ell as radiance and ab- 
sorption of the column of air through which the object is viewed. 
However, the vatio of the radiances at the two wavelengths is 
reasonably independent of factors other than reflectance. Water 
and vegetation can be separated from clouds, snow, and bare land 
on the basis of this ratio alone. However, the radiance ratio for 
bare land is essentially the same as that for clouds and snow so 
these features must be separated on the basis of absolute radiance. 
This can be done with only a rough estimate of the solar illumina- 
tion angle. The reflectances of clouds and snow are much higher 
than most bare-land reflectances. Errors will be made in the case 
of such highly reflective features as limestone and white sand, 
but such features constitute a small fraction of the Earth's sur- 
face . 
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Wavelength, ym 

Figure 1 Target Speetral Radiances 


Figure 2 Illustrates how readily the various types of features 
can be separated. The figure was based on a computer model that 
considered such factors as visibility (as low as 5 km) illumination 
angle Cftom 0° or normal to the Earth's surface to 41°), sensor 
noise, pixel nonuniformity and dark current, viewing angles up 
to 5° from normal, a variety of vegetation and bare land types, 
and 2 degrees of water turbidity. Although the polygons in Figure 
2 overlap to a certain extent, because they represent 99% confidence 
limits the majority of cases can be expected to fall in unambiguous 
points on the plane. The analysis indicates that a classification 
accuracy of better than 95% can be expected for pure signatures 
under typical viewing conditions. As previously mentioned, certain 
types of features such as limestone will be misclassif led and cer- 
tain mixed features such as winter forests, extremely distressed 
vegetation, and swampland have no unique classification. However, 
the accuracy achieved is expected to be adequate for a wide variety 
of applications. 
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Red Camera Volts 



Infrared Camera Volts ^Vj^j 


Figure 2 997o Confidence FoVggons , Sun 41 to 60.'* from Zenith 


K. EXPERIMENT DESCRIPTION 


The FILE experiment will test the previously described classifica- 
tion technique by observing the Earth from orbit aboard the Space 
Shuttle, using two boresighted CCD television cameras. The cameras 
will view through optical filters for 650 and 850 nanometers, re- 
spectively. Approximately 120 frames of data will be stored on 
tape in a recorder that is an integral part of the experiment. 

Data for each frame will include digitized television images from 
the two cameras, a count of the number of picture elements in the 
scene that were classified in each category, and the date and time 
of day (from which the scene's latitude and longitude can be 
determined) . For comparison, a 70-mm film camera will take a 
color picture for each data frame. 
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To test the ability of the system to make real-time data acquisi- 
tion decisions, and to increase the varxety of the data returned, 
the instrument will count the number of frames of data repre- 
senting scenes that are predominantly either water and clouds or 
Bare land. It will not record data for scenes in either of these 
classes after 32 frames have been taken. 

From the data, a four-color hard-copy picture can be constructed 
for each data frame for comparison with the correspondxng photo- 
graph.. The data will be analyzed to determine classification 
accuracy, reasons for misclassifications, and appropriate adjust- 
ments to decision thresholds. 


C. HARDWARE DESCRIPTION 


The FILE system comprises five hardware assemblies, which are 
fastened to a single baseplate to facilitate handling (Fig. 3). 



Figure 3 FILE System General Arrangement 
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The sensor and electronics unit contains television cameras and 
decision-making electronics, controls the entire experiment, and 
IS the only interface with the Shuttle. Figure 4 is a block 
diagram of the unit. It receives power and a GMT time signal 
from the Shuttle and sunlight through a light pipe from the sun- 
rise sensor mast to inhibit operation on the dark side of the 
Earth. It sends data to the tape recorder via a buffer memory, 
and produces control signals to operate the film camera and buffer 
memory. 


+28 V Power from Shuttle 

• +28 V Power to Buffer Memory 
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Figure 4 FILE System Block Diagram 


The television field of view is 18° x 23°, which corresponds to an 
area of 9300 km^ on the ground. Each picture element therefore 
corresponds to an area of approximately 1 km^. The film camera 
has a 32° square field of view, which corresponds to 25,000 km^ on 
the ground, and a 100-m resolution can be expected. 

Classification decisions are made by using voltage dividers on the 
camera outputs, comparators, and a reference voltage. Comparator 
outputs are logically combined, producing gating signals to route 
clock pulses to pixel counters corresponding to the various types 
of features. 

The buffer memory accepts the higher data rate from the sensor and 
electronics unit and plays it out at a much lower rate that can 
be accepted by the tape recorder. 
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D. 


EXPECTED RESULTS 


The FILE experiment is expected to establish the practicality of 
making autonomous real-time decisions for satellite data acquisi- 
tion by means of a simple technique for scene analysis. The 
experiment is intended to be the first in a series of progressively 
more sophisticated experiments leading to an adaptive real-time 
search, identification, and pointing system with the objective of 
providing a significant reduction in the end-to-end data manage- 
ment problem through selective data acquisition. 
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FILE TRADEOFF STUDIES 


A number of tradeoff studies were performed under this contract 
to select components for the FILE experiment. Components include 
the tape recorder, film camera, and TV cameras. 


TAPE RECORDER SELECTION 


Table 1 is a list of tape recorders considered. Some recorders 
would require extensive modification to survive in the environ- 
ment and operate from 28 Vdc. Any of the candidate recorders 
would represent a significant fraction of the total cost of the 
experiment. Therefore, when it was learned that a Lockheed model 
4200 recorder could be acquired from NASA, the decision was 
obviously in favor of this recorder. It has the storage capacity 
required, was designed for the environment, and will be avail- 
able when required for the experiment. 


FILM CAMERA SELECTION 


The film camera decision was also based on the availability of a 
suitable space-qualified camera at no cost. Two such cameras 
were available — a 70-ram Hasselblad camera and a 16-mm camera. ‘ The 
latter would give poorer resolution, and the manufacturer is no 
longer in business, so replacement parts procurement was a poten- 
tial problem. The Hasselblad camera was therefore selected. 


TV CAMERA SELECTION 


Many TV cameras are available at moderate cost. Table 2 shows 
the characteristics of eight representative cameras that were 
considered. The field was considerably narrowed by FILE system 
requirements for linear (unity gamma) response and sensitivity 
from 650 to 850 nanometers, the desirability of low-voltage oper- 
ation, low-noise, 40:1 dynamic range, and cost — all of which 
pointed to solid-state arrays . 



Table 1 'Preliminavy FILE Program Candidate Tape Recorders 


Recorder 

Frequency 

and 

Type 

Available 

Recording 

Time 

Design 

Environment 

Weight , 
lb 

Availability 

Cost, $ 

Lockheed 
Type 4200 
(modified) 

500-klIz 
analog , 

4 tracks 

600 to 

1100 

frames 

Space 

Shuttle 

7 

6 months 
(with 

modif ications) 

24k recorder 
4k ground 
playback 

Amp ex 
AR 728 
(modified 
for Skylab) 

1-mbps 
digital , 
28 tracks 

24 

minutes 

Aircraf t 
(modified 
for space) 

90 as 
modif led 

Skylab 
spares only 
(not located) 

Possible 
GFE (if 
located) 

Sony 

Beta Max 
SL 6200 

4.50MHz 

analog 

60 

minutes 

Ground 

45.2 

Commercial 

off-shelf 

1300 list 
(plus mods) 

AFAI 

VTS-IOOS 

4 . 5-MHz 
analog 

23.5 

minutes 

Ground 

11 

Commercial 

off-shelf 

1100 list 
(plus mods) 

RCA 
Star 3 

5 . 0-MHz 
analog 

60 

minutes 

Aircraf t 

40 

6 to 7 
months 

50k 

Odetics 
DDS-3000 
(for SCATHA) 

8-kbps 
digital , 
2 tracks 

720 

minutes 

Space 

14.5 

12 to 15 
months 

90k 

Echo 

Scientific 34 
(for SCATHA) 

64-kbps 
digital , 
8 tracks 

11 

minutes 

Space 

16.5 

TBD 

TBD 


















































Table 2 Candidate TV Cameras and Sensors 



Manufacturer 


RCA 

RCA 

RCA 

Fairchild 

General 

Electric 

General 

Electric 

General 

Electric 

Fairchild 

(chip) 

Camera 

Identification 

TC 1150 

TC 1155 

TC 1160 
AD or BD 

MV-201 

TN-2000 

TN-2200 

TN-3000 


Sensor 

Identification 

SID 51232 

SID 51232 

SID 52501 

CCD 211 

CID 

CID 

CID 

CCD 202 

Pixels 

Actual 

256 X 320 

256 X 320 

256 X 320 

244 X 190 
= 46,360 

250 X 200 

128 X 128 

250 X 200 

100 X lOO 
= 10,000 

Pixels 

Effective 

512 X 320 
= 163,840 

512 X 320 
= 163,840 

512 X 320 
= 163,840 

(Later coming) 
(488 X 380 
= 185,440) 

500 X 200 
= 100,000 

128 X 128 

= 16,384 

500 X 380 
= 190,000 

100 X lOO 
= 10,000 

Temperature 

-12 to 50°C 

-12 to 50°C 

-12 to 50“C 

-50 to 40°C 

0 to 50°C 

0 to 50'’C 


-25 to 55°C 

Humidity 

0 to 90% 

0 to 90% 

0 to 90% 


0 to 90% 



~ 

Weight 

2.5 lb 
plus lens 

2.5 lb 
plus lens 

2.2 lb 
plus lens 

12 oz 
plus lens 

43 oz 
plus lens 

18 oz 
plus lens 



Size, in 

2.75 X 5.88 
X 4 .5 
plus lens 

2.75 X 5.88 
X 4.5 
plus lens 

2.75 X 5.88 
X 4 .5 
plus lens 

2.5 X 2 
X 3.75 
plus lens 

8.5 X 4.4 
X 2.3 
plus lens 

App 2 . 4 
dia. X 7.3 
in. , incl 
lens 


■■ 

Power 

4 W 12 Vdc 

4 W 12 Vdc 

4.9 W 
12 Vdc 

4 W 12 Vdc 

9 W to 
supply 
7 W to 
camera 

1.5 W 



Lens 

Built- in, 

14 to 4 5 -mm 
efl 

Any 

C-mount 

Any 

C-mount 

Any 

C-mount 

Any 

C-mount 

Any 

C-mount 


Any 

C-mount 

Bias 

Light 

Required 

(built-in) 

Required 

(built-in) 

Required 

(built-in) 

No 

No 

No 

No 

No 

Cost 

Obsolete 

Obsolete 

AD $1976 
BD $2950 

$6000 

$2700 to 
$3000 

Approx 

$1000 

Less than 
TN-2000 

<$400 

Delivery 

30 days 

30 days 

30 days 

Approx 
60 days 

30 days 

Approx 
30 days 

Earlv 

1978' 

Approx 
30 days 
































































































Figure 5 illustrates system constraxnts that further influenced 
sensor selection. None of the constraints represents a "hard" 
limit of practical operation. Rather, the constraints represent 
reasonable limits in view of system performance goals and imple- 
mentation decisions that involve many considerations. For example 
the "smear" limit is based on the rate at which the tape recorder 
system can accept video information and on A/D conversion speea. 
These performance limitations were in turn imposed by economic 
considerations and the desirability of making the tape recorder 
system convenient to use in future missions. Likewise, the 
"recognition" limit is a subjective estimate of the number of 
pixels required for a human observer to adequately recognize the 
scene during postflight data reduction. In short, the constraints 
define a reasonable operating area compatible with a number of 
factors that are peculiar to the experiment. 



Number of Picture Elements/Line 

Figure 5 TV Camera Constraints 
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The upper limit on the number of pixels is partly established by 
noise considerations. Pixel rate is limited by the recorder and 
A/D converters, which means that readout time for a complete frame 
is proportional to the total number of pixels in the frame. For 
an integrating sensor, this means that dark current starts to 
become a significant contributor to the signal when the number 
of pixels becomes excessive; and, while temperature compensation 
can remove the average dark signal from the picture, the dark 
current nontcnifomrity remains as a source of noise. The limit of 
130 pixels per line keeps this nonuniformity noise to a small 
percentage of normal signal amplitude at expected maximum oper- 
ating temperature. 

This limit is also established by tape-recorder storage capacity. 

The use of a 100x100 pixel camera instead of, for example, a 
320x512 pixel camera allows recording of 16 times more frames. 

For a tape capacity of 16.1 megabits, this makes the difference 
between 100 frames and 6 frames. Obviously, many more scenes 
and viewing conditions can be realized by using a small-format camera. 
Moreover, a smaller buffer memory can be used with a smaller number 
of pixels, if such a memory is required because of a limited tape- 
recorder data rate. 

The RCA Big SID camera was eliminated, not only because it has 
too many pixels, but also because the chip must be floodlighted 
with, a LED light source for proper operation. This so severely 
limits its dynamic range that it is useless for this application 
without some form of iris control. 

An operating point near the one selected was considered most 
desirable in terms of postflight data analysis because a wide 
field of view and many pixels in the scene both facilitate recog- 
nition of the observed area. 

There are two readily available low-cost sensors that appeared 
to meet all the requirements, so these were examined in more 
detail: (1) the GE TN2200 camera, which uses a charge- injection- 
device (CID) sensor with a 128x128 pixel format; (2) the Fairchild 
CCD202 chip, a CCD sensor with a 100x100 format. Samples of both 
were purchased and evaluated. It was found that the Fairchild 
sensor, with the manufacturer's "evaluation board" support cir- 
cuitry, produced recognizable images over an illumination range 
well in excess of 40:1. The image from the CID camera became 
totally devoid of any detail when light intensity was reduced by 
a factor of 40 from saturation. This limited range could be com- 
pensated for by using a movable iris, but the cost advantage of 
fixed optics was significant. 
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Several other factors also favored the CCD chip: (1) support cir- 

cuitry for scanning and signal processing is less complex; (2) the 
manufacturer offered good data on the chip; (3) the manufacturer 
also provided recommended circuits and suggestions. In contrast, 
the CID is not generally offered without the complete camera, little 
information about the chip was available (no data sheets) , and the 
manufacturer appeared to be interested only in a mass market for 
complete systems. Because the existing CID camera design did not 
appear appropriate for the application, the Fairchild CCD chip 
was selected. 


D. TERMINATOR AND SUNRISE SENSING TRADEOFF 


It would be desirable to eliminate the FILE sun sensor mast and 
synchronize FILE system operation with the orbit by sensing the 
Earth's terminator. This would make the system less dependent 
on the orbit and Shuttle attitude and would simplify mechanical de- 
sign problems. The practicality of doing this was examined, but it 
was determined that it would not be a simple change, for several 
reasons . 

First of all, the sun sensor approach had been studied well before 
FILE design was begun. Earth-viewing terminator sensors were not 
considered until it was realized that the FILE was to be mounted 
in the shade. The former technique could therefore be implemented 
more quickly. This was a significant consideration in view of 
the schedule constraints imposed by the planned launch date and 
available budget . 

Second, the spectral-radiance-analysis computer program currently 
available uses a "flat Earth" model, which is adequate for the 
FILE camera analysis (with the sun within 60° of zenith and 
essentially nadir viewing) . However, there are no reliable data 
available to use in setting a threshold for a terminator sensor. 
Moreover, extrapolation of data from the available model suggested 
that terminator sensing would not give an accurate indication 
because clouds near the terminator would tend to turn the instru- 
ment on early, whereas water would tend to turn it on late. The 
error appeared to be on the order of ±15°. The FILE sensor uses 
absolute radiance to separate clouds from bare land; and, though 
the radiance "gap" between these types of features is wide, it is 
desirable to operate the system with the best available data on 
scene lighting while trying to prove its principles of operation. 
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Fxnally, for future flights, FILE can easily be modified to accept 
an input from a terminator sensor. The only changes would be in 
the time delay between the sensor signal and the start of oper- 
ation and in the interface circuitry and connectors to accept the 
signal. Alternatively, it may be possible to use the camera 
outputs themselves to make fine adjustments in the cloud/bare- 
land threshold and thus eliminate the need for coarse Sun angle 
information. 
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IV. 


FILE PERFORMANCE ANALYSIS 


This chapter summarizes the results of the performance analysis 
for the FILE/OSTA-1 mission. 


A. DECISION THRESHOLD SELECTION 


The FILE system classifies pxxels as water, cloud or snow, bare 
land, or vegetation on the basis of their radiances at two dif- 
ferent wavelengths and the ratio of the radiance at one wave- 
length to the radiance at the other. A computer (T-RAD-1) was 
used to determine appropriate decision thresholds to use in the 
flight instrument. As inputs, the program takes target reflec- 
tance, reflectance of the area surrounding the target, visibility, 
angle between a line normal to the Earth's surface and a line to 
the sun, angle between the line normal to the Earth's surface 
and the line connecting the observer and target, and the angle 
between the vertical planes containing the target- sun and target- 
observer lines. From these data, it determines the path radiance 
and total radiance observed based on a homogeneous, conservative 
plane-parallel atmosphere model with a perfectly diffuse surface 
by application of the double delta function and the Shuster- 
Schwarzschild approximations. The accuracy of the program has 
been confirmed by comparison with data taken aboard Skylab. 

The T-RAD-1 program was found to be more flexible than necessary. 
For example, only two wavelengths are of concern, and only one 
altitude need be modeled. Moreover, it is a large complex pro- 
gram that could not be readily modified to serve as a subroutine 
in a program that added the effects of sensor pixel nonuniformity , 
lens systems, dark current, noise, attitude stability and variation 
of sun angle with orbit position. Therefore, the program was used 
to establish key data points, and approximating functions were de- 
rived by curve fitting for use in an analysis program. The latter 
program considered the effects of the factors mentioned above and 
produced cumulative probability ogives (by Monte Carlo analysis) 
for both radiances and radiance ratio (Fig. 6 through 15). The 
analysis assumed the orbit to be similar to the baseline OFT-2 
orbit as it was known at the time. This orbit has a low "beta" 
angle, i.e., the line between the Earth and the sun is within a few 
degrees of the orbit plane. 
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Probability that Ratio Is Not Probability that Ratio Is Not 

Geater than R Greater than R 



Figure 6 Cumulative Probability Ogives for Fairchild CCD202 
at S-km Visibility, 0 to 60° Orbit Angle, 650 ran 



Figure 7 Cumulative Probability Ogives for Fairchild CCD 202 
at 23~hn Visibility , 0 to 60° Orbit Angle , 650 ran 
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Value of V, volts 

Figure 8 Cumulative Probability Ogives for Fairahild CCD 202 at 5-hn Visibility ^ 
41 to 60° Orbit Angle, 650 nm 



Value of V , volts 


Figure 9 Cumulative Probability Ogives for Fairahild CCD 202 at 23-hn Visibility, 
41 to 60° Orbit Angle, 650 nm 
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Figure 10 Cumulative Probability Ogives for Ea'irdhild CCD 202 at 5-km Visibility, 
0 to 41° Orbit Angle, 650 nm 



Figure 11 Cumulative Probability Ogives for Fairchild CCD 202 at 22-T<m Visibility , 
0 to 41° Orbit Angle, 650 nm 
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Figure 12 Cumulative Probahility Ogives for Fairchild CCD 202 at 5-hn Visibility, 
41 to 60° Orbit Angle, 850 nm 



Value of V , volts 


Figure 13 Cumulative Probability Ogives for Fairchild CCD 202 at 23-hn Visibility, 
41 to 60° Orbit Angle, 850 nm 
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Figure 14 Cumulative Probability Ogives for Fairchild CCD 202 at 5-hn Visibi 
0 to 41° Orbit Angle, 850 nm 
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Figure 15 Cumulative Probability Ogives for Fairchild CCD 202 at 23-hn Visibility 
0 to 41° Orbit Angle, 850 nm 















It was found that separation of bare land and clouds would require 
some knowledge of the sun elevation, and two ranges were found to 
be adequate — one threshold could be used with the sun within 41° 
of zenith and a second could be used when the sun was between 41° 
and 60° from zenith. I'Jh.en the sun is beyond 60° from zenith, the 
radiance varies rapidly with sun angle, and extension of FILE 
operation with such large angles would require relatively precise 
knowledge of sun position. 

From the probability curves, the polygons in Figures 2 and 16 
were established. The polygons define the ranges of output voltages 
from the two FILE TV cameras for the various generic types of fea- 
tures. Three "difficult" features have been ignored in drawing 
the polygons: (1) limestone (which looks like clouds or snow); 

(2) black earth; (3) coniferous winter forests. The deletion of 
limestone is justified by the fact that it represents an extremely 
difficult case. Even a human observer would find it difficult to 
distinguish it from clouds or snow on a pixel-by-pixel basis. 

Black earth is so dark that path radiance dominates, and it there- 
fore would occasionally have a signature that mimics vegetation. 

Both of these features represent such a small fraction of the 
Earth's visible surface that special efforts to properly classify 
them did not appear warranted. Conifer winter forests were de- 
leted because they are a mixture of two categories (snow and 
vegetation) and therefore do not fit into any single category. '' 

The set of features used to generate the cumulative probability 
ogives was by no means exhaustive. But it had a wide enough 
variety of types of vegetation and bare land and water turbidities 
to establish that a simple instrument can provide useful classifi- 
cation accuracy using only the voltage from one of the cameras 
and the ratio of the outputs of the two cameras. 

The selected decision thresholds are shown superimposed on the 
polygon plots in Figures 2 and 16. Where the polygons overlap, 
the decision threshold has been moved a little toward the less 
common feature to minimize the error rate, as with a Bayesian 
classifier. However, the relative seriousness of the different 
possible errors — calling bare land vegetation, calling vegetation 
cloud, etc — is application-dependent. For an experiment designed 
to prove a principle with potential for a variety of applications, 
it made little sense to use a formalized approach because of the 
subjectivity of any estimate of the seriousness of an error. For 
a future application in which error costs are readily calculated, 
it might be reasonable to use, for example, Neyman-Pearson de- 
cision logic to set the thresholds. However, greater benefit 
can probably be derived by adding more comparators, voltage 
dividers, and logic to the classification circuit, to tailor the 
decision boundary shapes to the shapes of the polygons, and by 
reducing the size of the polygons through more accurate estima- 
tion of the solar illumination angle. 
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Figure 16 99% Confidence Polygons, Sun 0 to 41° from Zenith 


FIELD MEASUREldENTS VERSUS ANALYTICAL MODEL RESULTS 


Mixed signatures present a potential problem to the FILE approach. 
If the scene content within one pixel is a mixture of cloud and 
water, FILE may classify it as bare land. Similarly, a mixture 
of water and vegetation in a pixel might be classed as bare land 
if the proportions were right — or the latter mixture might be 
classified as vegetation, even when it was over 50% water, because 






of vegetation's higher radiance. Field measurements were there- 
fore taken to determine whether typical real signatures approxi- 
mated signatures predicted by the analytical model. Two separate 
trips were taken to obtain data during two seasons. 

Summer observations were made with a LANDSAT spectral radiometer, 
with a 1° field of view. This Instrument has two bands that 
approximate FILE optical filter bands. Channel 1 has response 
from 580 to 706 nanometers, with a peak between 600 and 650 
nanometers, which corresponds to the FILE 650-nanometer band. 
Channel 2 has response from 767 to 974 nanometers, corresponding 
to the FILE 850-nanometer band. The LANDSAT bands are wider than 
FILE bands; but, on the basis of available spectral signatures, 
the two-band radiance ratio can be expected to be close to the 
FILE design model radiance ratio. This was found to be the case. 
Table 3 compares field observations with nominal ratios from the 
analytical model. 


Table 3 

Comparison of Summer Field Measurements with FILE Design Model 



Radiance Ratio 

Feature 

Ground-Based Field 

Measurement 

CCh 1/Ch 2) 

FILE Design Model 
650 n mi/850 n mi 

Coniferous Summer Forest 

0.32-0.382 

0.494 

Deciduous Summer Forest 

0.118-0.201 

0.300 

Clear Water 

2.2 

3.29 

Clouds 

1.51-1.56 

1.50 

Grass 

0.532-0.534 

Vegetation 
High 0.86 
Mean 0.308 
Low 0.266 

Bare Areas 

1.22-1.38 

1.21-1.41 


The winter field trip obtained data on snow and ice. An ERTS 
radiometer was used to obtain measurements in bands from 600 to 
700 nanometers and 800 to 1100 nanometers. Fourteen targets were 
measured in varying weather conditions, both at Dillon Reservoir 
and at the Shrine Pass turnoff on Interstate 70 in Colorado. 

A pine forest with very little snow gave a radiance ratio of 0.53, 
compared to 0.494 for the FILE model. Thus, summer and winter 
observations were found to bracket the value used in the model. 
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The remaining observations were of snow. They included bright 
snow (azimuth 150° from the sun) , deep snow (azimuth 120° from 
the sun) , and 4-inch snow viewed through blowing snow (azimuth 
90° from the sun). Five targets were observed, and all had 
radiance ratios from 1.58 to 1.63 values, v^hich compare favorably 
with the FILE model radiance ratio of 1.78. 

The ratios agreed well with the FILE model despite the fact that 
the model is for satellite-based ratios and the bands were some- 
what different. Furthermore, the ratios appear to be independent 
of sun-sensor viewing angles angles and atmosphere conditions. This 
fact provides confidence that gound-based tests will be a useful 
prelaunch check of FILE operation. 


C. ERROR-RATE ANALYSIS 


An error-rate analysis was done with the FILE analytical model 
and the decision thresholds in Figures 2 and 16 . The analysis 
assumed pure targets, i.e., mixtures of types of features within 
a pixel were not used. The analysis included such factors as 
orbit position, camera noise, pixel nonuniformity, dark current, 
atmospheric effects, and viewing angle. The results are shown 
in Table 4. Because the FILE system estimates the illumination 
angle on the basis of the time delay from the last sunrise, the 
analysis modeled a position uncertainty of 1.67° (la), with a 
normal distribution. 


Table 4 Classifiaation Ei>rors 


Feature 

% Called 

Water 

Veg 

Cloud 

Bare 

Cloud 

0.0 

0.0 

100.0 

0.0 

Wheat 

0.0 

100.0 

0.0 

0.0 

Low Vegetation 

0.0 

100.0 

0.0 

0.0 

Corn 

0.0 

100.0 

0.0 

0.0 

Deciduous Summer Forest 

0.0 

100.0 

0.0 

0.0 

Mean Vegetation 

0.0 

100.0 

0.0 

0.0 

Coniferous Summer Forest 

0.0 

100.0 

0.0 

0.0 

Fall Forest 

0.0 

100.0 

0.0 

0.0 

Alfalfa 

0.0 

100.0 

0.0 

0.0 

Deciduous Winter Forest 

0.0 

97.1 

0.0 

2.9 

High Vegetation 

0.0 

100.0 

0.0 

0.0 

Coniferous Winter Forest 

0.0 

65.5 

0.0 

34.5 

Black Earth 

1.0 

8.9 

0.0 

90.1 

Granite 

0.0 

0.7 

0.2 

99.1 

Bare Area 

0.0 

0.6 

0.0 

99.4 

Limestone 

0.0 

0.0 

100.0 

0.0 

Snow 

0.0 

0.0 

100.0 

0.0 

Clear Water 

100.0 

0.0 

0.0 

0.0 

Muddy Water 

100.0 

0.0 

0.0 

0.0 
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As expected, the highest error rates are for winter scenes — 
mixtures of snow with vegetation — and limestone and black earth. 
For many feature types, the error rate was essentially zero. 


D. DATA-TAKING INTERVAL ANALYSIS 


The last FILE analysis to be described was to determine how often 
the FILE system should be activated to give a high degree of con- 
fidence that the full data-storage capacity would be used while 
providing good variety in the collected data. For this analysis, 
a map of the world was entered in the computer. The map was 
divided into cells of 5° latitude by 5° of longitude, and a scene 
class — water, bare land, or vegetation — was assigned to each cell 
as snown in Figure 17. 

Clouds were then randomly superimposed on the map and a simulated 
mission was "flown" over the map with the OFT-2 reference flight 
profile orbit. Each time the simulation indicated that the FILE 
system would attempt to take data, latitude and longitude were 
calculated and used to look up the "scene class" on the map. 

\-fhere the scene class was bare land, water, or cloud, the cor- 
responding scene class counter was checked and incremented. If 
the counter had not reached a full count — or if the scene was 
vegetation — a "picture" was taken. The simulation kept track of 
the number of pictures taken versus time. 

A total of 200 simulated missions were run for each analysis so 
that statistics could be compiled. The selected 2.75-minute 
picture-taking interval was established by iterating the analysis 
for different intervals. 

Three separate cloud models were used, and all three gave similar 
results. In one model, a random number was assigned to each cell 
on the map. A "slicing threshold" value was then adjusted so 
that half the cells had random numbers above the threshold and 
half had numbers below it. Cells with numbers above the threshold 
were then labeled cloud cells. In another model, the random numbers 
were averaged with adjacent cells before the slicing threshold 
was applied. This generated larger clouds and larger areas where 
the ground x^as visible. In the third model, the averaging with 
adjacent cells was done twice. This produced supercontinental- 
sized clouds. Figures 18, 19, and 20 show typical cloud patterns 
with these models. 
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Figure 17 World Map Cwithout clouds) 
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Figure 18 Small Cloud Model Ctypioal run) 
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With the 2.75-minute interval, the following results were found 
to be typical for any cloud model: 

]) The best case produced 120 pictures in 35.4 hours; 

1 

2) The worst case produced only 85 pictures in 96 hours - 

a) 32 bare land (full limit), 

b) 21 vegetation and mixed signature, 

c) 11 all water, 

d) 21 clouds ; 

3) Half the simulated missions ran 63.7 hours or less to get 
120 frames of data; 

4) 77.5% of the missions produced 120 frames of data in less 
than 84 hours ; 

5) 12% did not produce 120 pictures in 96 hours; 

6) Typically, 54.9 to 80.3 hours were required to get 120 frames 
of data. 

This simulation was based on a 96-hour ZLV period. Because it 
now appears that the actual first flight of FILE will allow as 
little as 65 hours for data taking, it would be wise to rerun 
this analysis when actual mission parameters are established. 

One interesting finding from the simulation was that data taking 
was concentrated in the most northern latitudes because these 
latitudes have the most favorable sun angles in the summer and 
because the rate of change of latitude with time is less at lat- 
itude extremes than near the equator. Therefore the results of 
this analysis are only valid for a summer mission. For a winter 
mission, data-taking will be concentrated in the southern hemi- 
sphere where there is less land. A winter mission can therefore be 
expected to require a shorter data-taking interval. On this basis, 
it is recommended that the analysis be repeated for any signifi- 
cant change in launch date. 
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V. 


ADVANCED FILE CONCEPT 


A. COASTLINE TRACKING ALGORITHM 


A coastline tracking algorithm was developed under a previous 
contract and reported in Reference 1. Under the current contract, 
analysis of this algorithm was expanded to include noise effects 
and error rate analysis. For the benefit of the reader who is 
not already familiar with this algorithm, the previously published 
description is repeated here. 

1 . Algorithm Description 

If a television camera scans a circular pattern over a high- 

contrast edge in an image as shown in Figure 21, the video signal 

will be (to a first approximation) a periodic square wave of the 

same frequency as the scanning rate. Scanning is accomplished by 

adding a voltage V = V sin (mt) to the vertical deflection 
X m 

voltage, and V = V cos (mt) to the horizontal deflection voltage, 
y m 

where V is much less than the deflection voltage required to cover 
m 

the width of the sensor field of view. 



Figure 21 Scan Configuration 


Volts 

h f 


Time 


(b) Video Signal 


If the fundamental-frequency sine and cosine coefficients of the 
Fourier series expansion of the video signal are interpreted as 
the horizontal and vertical components of a vector, the vector 
is found to be perpendicular to the edge and pointing toward the 
brighter side of the edge. Vector length is greatest for sharp 
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high-contrast edges and has maximum length when the circle is 
centered on the edge. If vector length xs divided by the video 
signal dc component, the result is essentially independent of 
scene brightness. 

Required coefficients are readily found with the circuitry in 
Figure 22, which uses analog computer techniques to directly 
compute the Fourier coefficients: 

2 tt/oj 

ao = f y* f(t)dt [1] 

0 

2 it/u 

= -^ y*f(t) cos (ojt)dt [2] 

0 

2 tr/o) 

b^ = -^ y* f(t) sin (wt) dt. [3] 

0 

The circuitry can be used to seek a coastline by sweeping the 
center of the circle back and forth across the middle of the image 
on the camera photocathode at a rate much slower th an the circ ular 
scanning. If the largest normalized vector length Yb^"^ + aj^^/aQ 
is greater than 0.22, a high-contrast sharp discontinuity has been 
found, and the tracker switches from acquisition mode to tracking 
mode. 

In the tracking mode, the circle is displaced on the photo-cathode 
after each decision, starting at the position with maximum normal- 
ized vector length as found above. Decisions are made by the 
following algorithm, which may be Implemented with analog or 
digital electronics or with an on-board computer, if one is pro- 
vided for other functions. In the algorithm, the "+y" direction 

is assumed to be in the direction of satellite travel, and x and 

o 

y^ are voltages to position the scanning. Initially, scanning 

is positioned at the point determined above. The following steps 
are then followed: 

1) Clear flip-flop A. This flip-flop passes a^ and b^ when 
cleared but multiplies them by -1.0 when it is set; 

2) Let % =~\jai^ + b^^ (this can be computed with analog circuitry 
if this IS most convenient in the particular system) ; 
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Figure 22 Circuitry for Computing Vector Components 













2 . 


3) If ai is greater than zero, the system will be tracking in 
the opposite direction from the satellite’s motion, so set 
flip-flop A to reverse the polarity of a^ and b^; 

4 Let Ay = k/5,, where k is a gaxn factor selected for best 

s ys tem performan ce, chosen during equipment design so that 
~\j (Ay) ^ + (Ax) ^ is a fraction of the circle radius; 

5) Let Ax = -bj k/£; 


6 ) 

7) 

8 ) 


Let d = Ay; 

X 

Let d = Ax; 

y 


Scan circles centered at ^xj = xq + d + Ax, y^ = yg + d^ + Ayj , 

{x 2 = XQ + Ax, Y 2 = Yo + Ay) , and ^xg = xg - d^ + Ax, yg = 

yn = d + Ay) , and determine new Fourier coefficients for each. 

The centering producing the maximum value ofw(aj')^ + 
is taken as the new |xg, ygl , and a^, bg, ag , and Z now become 


the values for this centering. 


-) 


9) If the procedure has not caused tracking off the photocathode 
and ZfaQ > 0.22, go to step 4; 


10) Otherwise, return to acquisition mode. 


Drift in analog circuits can be tolerated if an analog approach is 
used to implement the algorithm, because the procedure is self- 
correcting with reasonable drift rates. Correction for satellite 
motion is required if a very narrow field of view is used. 


The high-resolution camera is positioned by the tracking camera 
voltages xg and yg in the preceding algorithm . Pictures are 
taken periodically when the system is in the tracking mode. This 
should produce a high percentage of coastline and river photo- 
graphs . 


Cloud Detection 


A sharp contrasting edge is not necessarily a coastline. The edge 
might be the boundary between forest and bare rock or soil, between 
irrigated land and desert, between cloud and land, or between cloud 
and water. To be most useful, the algorithm should distinguish 
between shorelines and other types of edges. 

One solution to this problem involves restricting the spectrum 
the camera "sees" to a part of the spectrum where coastlines tend 
to produce vectors much longer or much shorter than other edges. 
Deep red appears to be the best part of the spectrum for this. 
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For example, at 750 nanometers, the reflectances of coniferous 
forest and granite are very nearly the same, so the "vector" pro- 
duced by the edge between these two types of terrain would be 
quite short. However, water has very little reflectance at this 
wavelength, and a water-granite or water-forest interface would 
produce a long vector. 

Unfortunately, interfaces between clouds and nearly all types of 
terrain would also produce long vectors, as shown in Figure 23. 

At a single wavelength, a cloud-land interface might produce a 
vector length very much like that produced by a land-water inter- 
face. The confusion can be resolved by computing the vector 
length again at, for example, 470 nanometers where a land-water 
edge would typically produce a shorter vector — in some cases even 
opposite in direction — while a cloud-land vector would tend to be 
near the same length at both wavelengths or actually be longer 
at the shorter wavelengths, as illustrated in Figure 24. 

Because the algorithm requires a wide but not particularly long 
cathode in the direction of satellite motion, this two-color 
measurement might be done with one camera. One half of the photo- 
cathode would be used for a scene filtered for 470 nanometers. 

The other half would be used for the same image filtered for 
about 750 nanometers. This arrangement is Illustrated in Figure 
25. If a dual-aperture image-dissector camera were used, the 
electronics package could simply switch in whichever image was 
desired or process both in parallel. 

A complete description of a tracker of this type is given in 
Reference 1 along with a discussion of the suitability of micro- 
processors for use in a tracker of this type. 

A laboratory experiment was conducted with a simulated cloud and 
a gelatin filter to verify that vector length changes in the 
expected manner with filtering. Experimental results agreed with 
predicted results, in which vector length was changed over a 
2.8:1 range by filtering. 
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CLOUD-GRANITE AND 
CLOUD-FOREST INTERFACES 
BOTH CURVES 
POINTING TOWARD CLOUD 



Figure 22 


Vector Length as a Function of 
Wavelength for Various Interfaces 



"Blue" Vector Length 

(Negative Value Indicates Polarity Opposite of Infrared Vector's Polarity) 


Figure 24 

Blue /Infrared Vector Pairs for 
Various Interfaces 
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Satellite Motion 


Acquisition Scan Line 




Filtered Image 
(working area) 


Tracking Range 
(return to 
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when leaving 
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Cloud 


Cloud Verification 
Area (filter selected 
to minimize typical 
shore~line contrast) 
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Figure 26 Image on Photooathode for Two-Band Scanning 


The second approach to cloud detection requires more sophisticated 
electronics but simpler optics. It is based on the fact that, 
compared to land, clouds and water both tend to appear very smooth 
at 750 nanometers. If the electronics package compares the ratio 
of ac component to dc component in the video signal on the "dark" 
side of the edge with that on the "bright" side, clouds might be 
recognized because the bright side in this case has less granularity . 
This approach shows somew’hat less promise than the multifilter 
approach described, but it would be smaller and lighter in weight. 
Laboratory experiments have not been conducted to test the second 
method," however, analysis indicates that it would be more apt to 
make errors than the other method. Good results might be obtained 
by combining the two techniques. 


Eoq)erimentat Results - The tracking algorithm has been tested. 
Figure 26 was produced by a PDP-9 computer from Figure 27 by 
implementing the algorithm with an image dissector camera and 
using an analog/digital Interface to allow the computer to simu- 
late the functions of some of the electronics. The computer pro- 
duces a line-printer plot of the scene, then, with a chart re- 
corder, traces on the plot the path it tracked, for a permanent 
record of the run. The scene used was a satellite photograph, 
as shown in Figure 27, To the scale of these images, the "scanning 
circle" diameter was approximately 6.8 millimeters (0.27 in.). 
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Figure 26 Record of Track Produced by Algorithm 


Figure 2 7 


LANDSAT 


Image of Chesapeake Bay 


In this experiment, there were no confusion factors such as clouds 
or high-contrast features other than coastlines, and no islands 
were encountered. More experiments were run to see what would 
happen when these factors were introduced. It was found that 
clouds over land were not frequently mistaken for coasts. This 
was probably largely due to chance and to the fact that the 
clouds were small with respect to the scanning circle. In one 
experiment, tracking proceeded normally until a coastal cloud 
was encountered. Tracking then went around the cloud until the 
satellite motion (simulated by computer software) moved the cloud 
out of the field of view. The algorithm then relocated the coast 
and continued tracking properly. Similar problems have been 
encountered with islands. The latter should be a minor problem 
in a real satellite because the content of the field of view com- 
pletely changes approximately once every 1.2 seconds, representing 
about 9 kilometers (6 mi) of satellite motion. This would auto- 
matically prevent continuous circling of the island. Analysis in- 
dicates that the clouds could be avoided by one or both of the 
cloud detection techniques described earlier. 

The minimum vector length for tracking in step 7 of the algorithm 
on page 33 was determined experimentally. Real coastlines in the 
pictures used produced vector lengths on the order of 0.25, and 
few other features produced lengths over 0,10. When the threshold 
was set to zero, the tracker wandered randomly over the photo- 
graph after coming to the end of a river. When the tracker again 
encountered a coast, it went back to tracking the coast properly. 
I'lhere picture brightness increased or decreased as a function of 
distance from the coast, the tracker tended to track a constant- 
brightness contour parallel to the coast for a considerable 
distance. The experiment used a threshold of 0.14 to track a 
feature and 0.03 to cause a return to the acquisition mode. A 
wide range of threshold settings between 0.03 and 0.25 seem to 
work well. The optimum setting is difficult to determine using 
photographs because it depends on what optical filtering is used 
and perhaps on sun angle and other factors. The maximum possible 
length is 0.6366. 

3. Recent Studies 


Under the current contract, the above experiments were expanded 
to include investigation of error rates and related parameters 
for such a system implemented with an image-dissector camera. 

The results of this investigation indicate that the conceptual 
simplicity of using the image dissector's random scan capability 
and essentially instantaneous response are offset by speed limi- 
tations caused by shot noise and photocathode degradation. 
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Traokinq Anqle and Veotov Lenqth Errors - Shot noise is one factor 
limiting the performance of a coastline tracker based on an image 
dissector. The noise will produce errors in both tracking direc- 
tion and tracking "vector" length. The former will cause the sys- 
tem to leave the land-water boundary. The latter could cause the 
system to abandon tracking altogether because the interface does 
not appear to have the contrast of a land-water boundary. 

To evaluate the effect of noise, a camera noise model that used 
a random-number generator was devised. The model included Poisson- 
distributed shot noxse simulating the front end of the camera 
tube followed by a log-normal random-gain model for the photo- 
multiplier. 

For analysis of tracking-angle error, the scanning circle was 
divided into 157 discrete steps and a noise-corrupted current 
sample was generated for each step. The phase shift from ampli- 
fier roll-off and dark current were also modeled. Amplifier 
noise was found to be insignificant compared to that from the 
photomultiplier, and was ignored. 

Figure 28 shows how the tracking angle varies with photocathode 
emission from the bright side of a simulated 90% contrast boundary. 
The analysis assumed a 5-kilohertz scanning rate, amplifier roll- 
off at 250 kilohertz, and a 25.4-p (1-mil) diameter round scanning 
aperture. The graph indicates that current densities above about 
1 yA/cm^ can be expected to provide fairly good tracking perform- 
ance. Because current densities up to about 8.2 yA/cm^ can be used 
with reasonable (6-year) camera life, tracking angle error caused 
by noise does not appear to be a significant problem. To verify 
this for lower contrast boundaries, the analysis was rerun for a 
range of contrasts. The results are presented in Figure 29. The 
simulated electronics and scan rate were the same as in the pre- 
vious analysis . 


As the figure shows, the tracking angle error is not greatly 
affected by the boundary contrast if contrast is above about 50%. 
Because tracking will always be on a high-contrast edge, it does 
not appear that tracking accuracy is a problem. 

Vector length is used for recentering the scanning circle on the 
land-water boundary and to distinguish land-water boundaries 
from cloud-land or cloud-water boundaries . 
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Bright-Side Photocathode Current, pA/Aperture Area 


Figure 28 Tracking Angle versus Photocathode Emission 



Contrast 


Figure 29 Error Angle versus Contrast for Various Current Densities 
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Measured Vector Length 


An error in determining the vector length could cause the instru- 
ment to stop tracking a true land-water interface either because 
it appeared to involve a cloud or because the interface appeared 
to have insufficient contrast for a coastline. Accuracy in deter- 
mining the vector length is therefore required to minimize errors 
in track/ don't track decisions. 

The same camera model was used to determine how measured vector 
length varies with true vector length (which is a function only 
of contrast) and photocathode current density. The results of 
this analysis are presented in Figure 30. Again, indicated cur- 
rent densities are for the bright side of the interface, and a 
5-kilohertz scan rate is assumed. 



Actual Vector Length 

Figure 30 

99. 5% Confidence Limits for Observed Vector Length- versus 
True Vector Length at Various Current Densities 


It appears that using the 5-kllohertz scan rate with this camera 
results in marginal operation, even with a current of 5 picoamperes 
through the aperture. The range for acceptable operation is on the 
order of 5 to 50 picoamperes; at the latter current density, photo- 
cathode life would be about ih months — far too short for most space 
applications. However, the effect of higher photocathode current den- 
sity can also be obtained by using a lower scanning rate. In general. 
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Vector Standard Deviation 


to multiply effective current density (from a noise standpoint) by 
a given factor, the scan rate must be reduced by a comparable 
factor. Figure 31 shows how the standard deviation of the ob- 
served vector length varies with photocathode current density and 
scan rate for a 90% contrast interface. 



Figure 31 

Vector Standard Deviation versus Photocathode Current 
Density for Tuo Scan Rates 


The results of this investigation suggest that the practical range of 
scanning frequency is about 200 to 1000 hertz, and the required photo- 
cathode current density is on the order of 16 to 80 pA/cm^ for an image 
dissector with a 25.4-p diameter. A Monte Carlo analysis was done to 
determine the probability of misclasslfying a boundary. All interfaces 
of clouds, bare land, wheat, muddy water, clear water, and average vege- 
tation were simulated with a scan rate of 1000 hertz and bright-side 
photocathode current densities of 40 and 80 pA/cm^. With the lower 
current density, the simulated system made errors about 5% of the time 
with each of the three interfaces. It occasionally classified an inter- 
face of bare land or wheat with clear water as a cloud edge, and oc- 
casionally accepted an area of clear water with no interface at all 
as a legitimate coastline. The reason for the latter appears to be that 
the signal level was so low, because of the low reflectance of the water, 
that the noise became a primary factor in determining vector length. 
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When the higher current density was used, the system made only 
one error in 420 scans. Again this was the acceptance of an area 
of clear water as a legitimate coastline. It appears that addi- 
tional logic could easily be added to reflect any interface with an 
average camera output below a certain level, and that this would 
cure the problem. Even the higher current density can be achieved 
with standard optics and does not present a difficult lens design 
problem. 

The relatively high photocathode current densities required and 
narrow operating range allowed by the competing factors of photo- 
cathode life and noise reduce the overwhelming advantages that 
were once thought to exist in using an image dissector. Moreover, 
the problem identified above, in which the system occasionally 
accepts water as a coastline, is readily avoided with direct re- 
cognition of feature types on a pixel-by-pixel basis as is done 
in the Feature Identification and Location Experiment (Ref 2) . 


RECOMMENDED IMPLEMENTATION FOR SURFACE-FEATURE TRACKING 


Recently it has been shown- that competing tracking technologies 
such as CCDs offer advantages in terms of life and performance. 

The scanning rate limitations imposed by the factors investigated 
bring the operating speed of an image dissector down to the range 
achievable with solid-state sensors. Other factors recommending 
solid-state sensors include: (1) solid-state cameras are, in 

general, less expensive than alternative sensors; (2) CCD tech- 
nology is still improving while significant improvements in image 
dissectors appear less likely; (3) FILE I preprocessing provides 
a convenient way to distinguish coastlines from cloud boundaries 
without added logic, (4) part of the FILE I design can be reused; 
and (5) CCDs do not present high-voltage problems. 

However, a CCD does not have a random scan capability. The pixels 
must be scanned in a predefined order and at a constant rate. 
Moreover, all pixels in the frame must be scanned each frame 
whether they are used or not. Implementation of the circular 
scan algorithm with CCDs will therefore involve a scene memory 
and predominantly digital operations as opposed to the analog 
operations of the original concept. Also the scanning circles can 
only be approximated because the CCDs have discrete picture elements. 

Because of the large amount of digital hardware required for a 
random-logic implementation, and because it is desirable to make 
the system flexible and expansible, a general-purpose digital sig- 
nal processor running from a program in memory looks attractive. 
Martin Marietta has been designing and analyzing such a processor 
based on the Advanced Micro Devices 2900 chip set. The microcode 
for such a processor can be used to generate control signals to 
operate dedicated random-logic portions of the Instrument and, 
where speed is not a limitation, it can replace random logic. 
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A program has been written to verify that a processor of this 
type operates fast enough to keep up with the CCD scan rate. 

It appears from this benchmark program and the current design con- 
cept that iteration rates on the order of 1000 per second can be 
handled. These rates are comparable to the capability of an image 
dissector system. Moreover, the flexibility of the processor 
allows this rate to be tailored to the requirements of the ex- 
ternal sensor or mount being controlled. 

This design allows for addition of features such as area corre- 
lation for recognition of specific landmarks, registration, other 
tracking modes, navigational update functions, and additional 
sensors whose formats and fields of view may differ from the 
CCDs' (e.g., IR sensors), without major effects on circuit design. 
In short, the system is being designed with incremental expansion 
in view. 

A bit-slice architecture was selected to provide software com- 
patibility with the PDF 11/45 FILE simulation computer. This 
architecture permits emulation of popular processors while main- 
taining a fast instruction execution time. 

The VILAT processor has eight general-purpose registers and eight 
addressing modes to permit the programmer to select the precise 
instruction needed for a specific operation. Addressing modes 
Include sequential forward or backward addressing, indexing, 
indirect addressing, and stack addressing. The eight general- 
purpose registers are not dedicated to specific functions. They 
can be used as accumulators, index pointers, sequential pointers, 
or as index registers. 

The VILAT processor uses device registers for input and output. 
Because the device registers can be manipulated by the processor 
as flexibly as memory, instructions that manipulate data in memory 
can be used equally well to transfer data to and from peripheral 
devices. The VILAT processor will implement only a basic subset 
of the PDP 11/45 instruction set. Table 5 lists the instruction 
set for the VILAT processor. 

Figure 32 is a detailed block diagram of the VILAT processor. 
Figures 33 through 40 are logic diagrams for each function block. 
The scene processor block is for future expansion, to provide 
registration capabilities. Special instructions for manipulating 
the scene processor can be added to the processor instruction 
set as needed. 


44 



Table 5 VILAT Processor Instruction Set 


Mnemonic 

Description 

CLR 

Clear register or memory location 

COM 

Complement (Is) register or memory location 

INC 

Increment register or memory location 

DEC 

Decrement register or memory location 

NEC 

Complement (2s) register or memory location 

TST 

Test register or memory location 

ROR 

Rotate right register or memory location 

ROL 

Rotate left register or memory location 

ASR 

Arithmetic shift right register or memory location 

ASL 

Arithmetic shift left register or memory location 

ADC 

Add carry to register or memory location 

SBC 

Subtract carry from register or memory location 

SXT 

Sign extend register or memory location 

MOV 

Move register to register, register to memory location, 
or memory location to register 

CMP 

Compare register to register or register to memory location 

ADD 

Add registers, register and memory location, or memory 
locations 

SUB 

Subtract registers, register and memory location, or 
memory locations 

BIT 

Bit test (AND) registers, register and memory location, 
or memory locations 

BIC 

Bit clear (A • B) registers, register and memory location 
or memory locations 

BIS 

Bit set (OR) registers, register and memory location, or 
memory locations 

XOR 

Exclusive OR registers, register and memory location, or 
memory locations 

BR 

Unconditional branch 

BNE 

Branch if not equal zero 

BEQ 

Branch if equal to zero 

BPL 

Branch if plus (or zero) 

BMI 

Branch if minus 

BVC 

Branch if overflow clear 

BVS 

Branch if overflow set 

BCC 

Branch if carry clear 

BCS 

Branch if carry set 

JMP 

Unconditional jump 

JSR 

Jump to subroutine 

RTS 

Return from subroutine 

MARK 

Mark (aid in subroutine return) 

HALT 

Halt 

NOP 

No operation 

CLC 

Clear carry status bit 

CLV 

Clear over-range status bit 

CLZ 

Clear zero status bit 

CLN 

Clear negative status bit 

CCC 

Clear all status bits 

SEC 

Set carry status bit 

SEV 

Set over-range status bit 

SEZ 

Set zero status bit 

SEN 

Set negative status bit 

see 

Set all status bits 
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Data Bus 
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Address Bus 
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Figure 33 VILAT Processor 4K 



Module Logic Diagram 








Figure 24 VILAT Processor Central Control Unit Logic Diagram 
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Fi-gure 35 VILAT Processor MParoprogrcomer Memory Logic Diagram 










Figure 36 VILAT Processor Arithnetio ccnd Logic Unit Logic Diagram 





Figure 37 VILAT Processor Memory Address Register Logic Diagram 



Figure 38 VILAT Processor Cloak Control and PEOM Memory Logic Diagram 







Figure 39 I/O Data Bus and Keyboard Logic Diagram 
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Figure 40 VILAT Processor Breadboard Interface Logic Diagram 










The Arithmetic and Logic Unit (ALU) (Fig. 32 and 36) provides the 
processor's computational capability. The heart of the ALU is the 
AM2901A microprocessor slice. The AM2901A contains an arithmetic 
unit, the eight general-purpose registers, and shifting logic. 

It receives control functions from the central control unit (CCU) . 

The clock control and CCU (Fig. 32, 34, and 38) provide control 
of all processor elements. The CCU sequences through the micro- 
program memory (Fig. 34 and 35) , which contains the control words 
required to execute the processor instruction set. The CCU con- 
tains an instruction register, which holds the instruction word 
while the set of microprogram memory control words are sequen- 
tially executed to satisfy the instruction-word requirements. 

The instruction word is decoded by a series of mapping PROMs to 
determine the microprogram memory starting address for the re- 
quired sequence of control words. The AM2911 microprogram se- 
quencer is used for microprogram memory address control. The 
AM2911 contains an incrementer and multiplexer. The microprogram 
memory address may be the next sequential address, the map address, 
or a branch address from the control word being executed. The 
clock control generates the clocks required by the processor, 
under control of the control word being executed. The clock con- 
trol also has manual reset, run, and halt capabilities. 

Processor instructions are stored in a volatile random-access 
memory (Fig. 32 and 33). The memory address is held in the memory 
address register (Fig. 32 and 37) . The address is calculated by 
the ALU and transferred to the memory address register. The 
memory address is also displayed on the processor control panel. 

A PROM memory (Fig. 38) provides nonvolatile storage of routines 
required to Initialize the processor and load special-purpose 
programs . 

The processor uses a request I/O structure. 1-Jhen an I/O device 
needs data from (or has data for) the processor, a request line 
is raised. There will be a request handler routine in the 
processor that will be executed when the processor is not busy 
with another task. Detection of the request will cause the 
processor to execute a routine to pass data to or accept data from 
the I/O device requesting access. This technique eliminates the 
time-consuming storing and restoring of general-purpose registers 
whenever a device requests access (which would be required with 
an interrupt system) . 

Four I/O functions will be provided: (1) an interface to the 

PDF 11/45 FILE simulation computer (Fig. 33); (2) an interface 
to the FILE breadboard (Fig. 33 and 40); (3) an RS-232C inter- 
face for standard computer peripherals (Fig. 32); (4) a control 
panel interface (Fig. 32 and 39). 
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The control panel is primarily used for checkout, troubleshooting, 
and software debugging. A 16-key keyboard is provided. Eight keys 
permit entry of the octal digits 0 through 7 ; the other eight are 
available for special functions. A data display is provided for 
monitoring keyboard entry and processor communication with the 
operator. 

The RS-232C interface is a general-purpose I/O port for connection 
to standard computer peripherals or another computer for special 
tests. A paper-tape unit or cassette deck could also be connected 
for program entry without connection to a computer. A terminal could 
be connected for a more convenient operator interaction capability. 

The FILE breadboard interface (Fig. 32 and 40) allows Droces<?nr 
operation with live scenes from the breadboard. To automatically 
control breadboard operation, a control word is passed from the 
processor to the breadboard. Classified data from each cell are 
encoded in a 3-bit word. The Interface then packs five of the cel’ 
words into one processor word and transfers it to the processor, ^n 
entire live scene can then be stored in the processor memory for 
later processing. A scene consists of 10,000 cells (100x100) , which 
can then be packed into 2000 memory words. 

The PDF 11/45 interface provides a high-speed parallel transfer 
between the processor and PDF 11/45. This will permit real-time 
interaction with FILE simulation at various stages in the program. 

As more capability is transferred to hardware, the processor will 
play a bigger role in the interaction. Initially, the processor 
will merely pass live scene data to the simulation computer ; 
whereas, in the final stages, the simulation computer will merely 
pass scene data to the processor, which controls the test. 



VI. 


NEW CONCEPTS FOR ADVANCED FILE-TYPE EXPERIMENTS 


A number of techniques can be included in future FILE-type experi- 
ments with the same basic hardware described in Chapter V. The 
Hardware has computational capabilities and is designed to accept 
additxonal devxces such as special scene processors, alternative 
sensors, and various mass storage devices. With these capabilities 
in mind, we investigated techniques for incorporating landmark regi- 
stration in the VILAT processor, and have simulated the techniques in 
the Martin Marietta Image Processing Facility (Fig. 41). The fac- 
ility can be separated into four areas: an xnteractive display, per- 

ipheral storage, central processor, and a hardcopy output line printer. 
These functional areas are connected by a common data bus that 
permxts interfacxng between any two. The central processor con- 
sists of a PDP 11/45 wxth 128K RAM memory that houses the software 
package desxgned for VILAT. 

The perxpheral storage area consists of two floppy dxsks (256K 
bytes each), two disk packs (2.5M bytes each), and four tape drives 
Ctwo seven-track and two nxne-track) . The total memory capacity 
of the configuratxon is 5.5M bytes, not counting the tape drives, 
which are slow to access but extend the memory capacity Indefinitely. 
The interactive dxsplay is composed of a RAMTEK random-access video 
display unxt wxth 240 lines by 320 elements. Interaction is made 
possible through use of a keyboard and joystick that interfaces 
through several software packages to control the dxsplay. 

The ultimate goal of addxng registration technxques to the processor 
is to develop the capabilities of autonomous navigation, sensor 
data registration, and commanded sensor pointing aboard an advanced 
FILE-type experxment. Two registration techniques were investi- 
gated under VILAT and a related IR&D task, and are described in 
the followxng sectxons. 


A. LANDMARK REGISTRATION SIMULATION 


The concept of using landmarks to register images is common in 
xmage processxng. Landmarks (also known as Ground Control Points 
(GCP) , Registratxon Control Points (RCP) , or anchor points) are 
small xmages wxth known geophysical coordinates. The known land- 
mark is found in a larger scene, and thus the larger scene (at 
least the local area xn the scene) is regxstered. The technique 
involves finding the best fxt of a "chip" in a "window." A chip 
is a small image Csize varies from 8x8 pixels to 32x32 pixels) of 
known latitude and longitude. The window is a large area to be 
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2.5m bytes 128K 



F-igure 41 Image Processing Facility 
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Figure 43 Registration of Area Landmark 









data received from the sensor to combine latitude, longitude, and 
time information with video data. Figure 45 shows the organization 
of the software. The heart of the program is in the correlation 
algorithm and a resampling technique. These components allow re- 
gistration to subpixel accuracy. 

In Figure 44 the sections of the program required in a flight 
system have been outlined, the other sections are only pertinent 
to the simulation and would not be present in the flight soft- 
ware. The outlined portxon of the software requires approximately 
3000 16-bit words of memory plus additional memory for a land- 
mark file. This size is compatible with state-of-the-art on- 
board processors. 

Two correlation algorithms have been Implemented (Fig. 45) and 
their results evaluated. On first evaluation, the classical cor- 
relator algorithm involving square roots and products of the 
pixel values was found to be inferior to the sequential similarity 
detection algorithm (SSDA) , which involves only the sums of ab- 
solute differences between chip and window pixel values. Not 
only is the classical correlator slower (because of the added 
multiplication) , making it less applicable to real-time oper- 
ation, but the algorithm converges more slowly than the SSDA, 
suggesting less accuracy as well. 

The SSDA has the added advantage that a decreasing threshold can 
be implemented to reduce the processing time. Because the algorithm 
converges toward zero as the similarity increases, a threshold can 
be established so that if, during calculation of the correlation 
coefficient, the SSDA sum exceeds some threshold value, computations 
are halted and the current position is known not to be the best fit. 
On the other hand, if the threshold value is not exceeded, the pre- 
sent landmark placement becomes the best fit and the new SSDA sum 
becomes the threshold for future calculations. This type of pro- 
cedure cannot be implemented with the classical correlator (which 
employs an algorithm that converges toward a maximum value as sim- 
ilarity increases) becuase all the calculations must be performed 
before any correlation information can be obtained. Though the SSDA 
does not employ the classical correlation algorithm to perform cor- 
relation, It does find the coordinates of best fit and is therefore 
frequently called a correlation algorithm in the literature. 

Registration to subpixel accuracy can be implemented in one of 
two ways: (1) the correlation surface can be interpolated; or 

(2) the image can be resampled at 1/lOth of the interpixel dis- 
tance and correlation around the best match location repeated. 

The second method was chosen because studies show that it 
achieves greater accuracy. Resampling involves interpolating 
between the discrete points on the intensity curve (Fig. 46) to 
form a new image surface that has been "shifted." Of the several 
resampling techniques implemented (Fig. 47), no one algorithm is 
clearly superior to all others. 
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Figure 44 Organization of Landmark Identification Program 









1) Sequential Search Detection Algoritm (SSDA) 


= |(Chip(i,j) - Chip mean) - (Window(i,j) - Window Mean) 

i=l j=l 


2) Classical Correlation = 


n n 


^ ^ ^ ] (Chip(i,j) - Chi 


Chip Mean) (Window (x,j) - Window Mean) 


i=l j=l 


^ ^ (Chip(i,j) - Chip Mean)^ EE (Window (i,j) - Window Mean)^| 


x=l j=l 


where : 


i=l j=l 


Chip (i,j) is the (i.j)*"^ pixel value in the n x n array of pixels 
representxng the landmark. 

til 

Window (i,j) is the (i,j) pixel in the n x n segment of the m x m array of 
pixels representing the overlapping area of the search area and the chip 
posxtxon. 


Chip Mean = EE Chip (i,j)/ n^ 
i=l j=l 


Window Mean 


i.1 LL 

=EE Window (i,j) / 


x=l j=l 
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Gray Scale Value 



Figure 46 Two-Dimensional Resampling of Intensity Curve 


The cubic convolution (CC) approach involves a cubic equation 
interpolation between pixels. When a smooth curve (corresponding 
to gentle features such as rolling hills) is being interpolated, 
the CC approximates the transition very well. However, when 
discrete features such as road crossings are used, the CC tends 
to smooth over the sharp transition between pixels. Because the 
SSDA correlation algorithm is best suited to sharp transitions 
and the CC tends to be a slower method of resampling, the CC will 
be ignored for the present. 

The bilinear algorithm is satisfactory when coarse data are used. 
However, this and the nearest neighbor algorithm tend to ignore 
the peak of the curve. The bilinear approach follows the in- 
tensity curve when the two surrounding slopes have the same sign 
as the slope of the segment being interpolated. When the two 
surrounding slopes have opposite signs, the algorithm fails to corn- 
puts the correct value. An algorithm we labeled the bilinear exag— 
gerator (Fig. 44) was designed to correct this problem. During 
smooth transitions in which the three slopes have the same sign, 
a bilinear interpolator is used. When a sharp transition is en- 
countered in which the surrounding slopes have opposite value, the 
exaggerator (which averages previous and current slopes to obtain 
a new pixel value) is used to magnify the transition. Although 
the bilinear exaggerator is a faster algorithm and appears to be 
better suited to landmark recognition, the cubic convolution in- 
terpolator should be reevaluated because it is more widely accepted 
in scientific circles. 
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Figure 47 Resampling Algorithms 
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Use of the SSDA correlation algorithm to achieve subpixel accur- 
acies has been examined in the Image Processing Facility. The pro- 
grams were written in FORTRAN, with no attempt at optimization with 
respect to size or speed of execution, with one exception — a moder- 
ate attempt was made to use fixed-point arithmetic whenever pos- 
sible. The PDF 11/45 executes fixed-point arxthmetic in 2 to 4 
microseconds , whereas a floating-point add requires 7 microseconds , 
and a multiply requires 10 microseconds. The time required for 
registration varies with the size of the landmark and search area 
and is summarized in Tables 6 and 7. 

The times shown in Tables 6 and 7 reflect the experimental mode 
of operation in which no decreasing threshold was used, so that 
analysis of the data could be more complete. 


Table 6 Whole-Pixel Searoh Timing Requirements 


Window Size 

Chip 

Size 

Time Required (sec) 

40 

X 

40 

pixels 

30 

X 

30 

pixels 

8.8 

40 

X 

40 

pixels 

26 

X 

26 

pixels 

12.3 

40 

X 

40 

pixels 

22 

X 

22 

pixels 

14.3 

40 

X 

40 

pixels 

18 

X 

18 

pixels 

14.3 

40 

X 

40 

pixels 

14 

X 

14 

pixels 

12.3 

40 

X 

40 

pixels 

10 

X 

10 

pixels 

8.8 

32 

X 

32 

pixels 

16 

X 

16 

pixels 

3.6 

76 

X 

76 

pixels 

16 

X 

16 

pixels 

69.5 


Table 7 

Subpixel Resample and Search 
Timing Requirements 

Chip Size Time Required (sec) 


30 

X 

30 

pixels 

19.0 

to 

27.0 

26 

X 

26 

pixels 

17.0 

to 

18.0 

22 

X 

22 

pixels 

10.0 

to 

13.0 

18 

X 

18 

pixels 

8.5 

to 

10.0 

14 

X 

14 

pixels 

4.5 

to 

6.0 

10 

X 

10 

pixels 

2.5 

to 

3.0 
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Experiments show that a, 6:1 improvement in execution time can be 
achieved by incorporating the decreasing threshold. The same 
studies also indicate that a 3:1 improvement in run time can be 
achieved if image resampling is linked to the SSDA and its de- 
creasing threshold. Thus, pixels are only resampled until the 
threshold Is surpassed. Improvements in execution time allow re- 
gistration of an 18x18 landmark chip on a 40x40 window in 5 seconds. 

Although autonomous landmark navigation is feasible, using state- 
of-the-art technology with 8-bit gray-scale data, the method has 
several shortcomings: time required for registration, effects of 

clouds on the registration process, and effects of seasonal 
variations. Experimental results showed that a nominal landmark 
search area could be registered in about 5 seconds. This time 
can increase to as much as 20 seconds if the uncertainty in posi- 
tion increases above expected values. Such registration times may 
be inadequate for the needs of a navigation system and will cer- 
tainly not be adapted to a sensor pointing system. Cloud coverage 
in the search area causes a decrease in the accuracy obtainable 
and can result in a false lock of the correlator CFig- 48). While 
a method of false-lock detection has been developed, the effects 
of missing a landmark sighting cause deterioration in the system's 
position accuracy. If several sightings are missed, the system 
may become divergent or uncontrollable. Just as clouds affect 
the system's registration accuracy, so do seasonal variations in 
the terrain. Such variations include snow coverage, spectra of 
vegetation, ice on lakes, etc. 

The system's limitations led to a concept of using the preclassified 
data proved by FILE instead of gray-scale image data. Such data are 
3 bits Instead of 8, and plxedls correspond to classification types 
such as clouds, bare earth, vegetation, and water. The 3-bit data 
will produce a significant decrease in registration time, and pre- 
liminary studies show that the process can be performed in approxi- 
mately 10 milliseconds if the correlation algorithm is hard-wired. 

By incorporating classified data in the system, any picture element 
that represents snow, clouds, or ice can be ignored during calcula- 
tions, significantly reducing the effects of these elements on cor- 
relation accuracy. The next section describes a simulation that was 
built around this idea under the VILAT program. 
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Fi-guve 48 Effects of Cloud Covevage 


B. ADVANCED FILE SIMULATION (MULTICOLOR REGISTRATION) 


The present FILE experiment was simulated in the Image Processing 
Facility. Images in two parts of the spectrum were displayed, 
and classified using the multispectral ratio approach. In the 
basic simulation areas from two LANDSAT tapes (different exposure 
times) of the same scene in the 0.6 and 0.8 micrometer spectral 
region were video displayed. A pixel-by-pixel ratio was then 
taken of the two areas, and a video representation of the results 
displayed. The number of picture elements in each region shown 
below was then printed along with the picture-element values of 
the two scenes. 


Multispectral Ratio 

0.0 - 0.9 

0.9 - 1.5 

1.5 - 3.0 

> 3.0 


Classification 
Vegetation 
Ground, Snow, 
Clouds, Ice 
Water 
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The basic FILE simulation was then incorporated in the landmark 
registration program so that the scope of an advanced experiment 
could be increased. 

The unique use of multispectral data in landmark registration 
diminishes the severity of problems encountered in the previously 
mentioned registration technique. First, the ratioing scheme 
enhances otherwise indistinguishable features, thus permitting 
selection of landmarks from a broader area. The enhancement also 
ensures that the correlation surface will converge more rapidly 
toward a best fit. Second, the effects of various noise sources 
on the correlation process can be significantly reduced because 
the ratio technique eliminates variations in the mean radiance 
value, and picture elements representing clouds, snow, or ice 
(major noise sources) can be Ignored during the correlation pro- 
cedure even though they may be used by the experiment. Third, 

3-bit data can be registered more quickly than 8- or 16-bit data, 
which will make autonomous navigation a more feasible goal. 

The simulator proceeds as described below and shown in Figures 
49 through 53. Input data consist of two sets of LANDSAT tapes 
of the same scene taken at two different times. Each tape set 
contains image data from bands six and seven of the LANDSAT 
multispectral scanner. The first segment of the program allows 
the user to select the coordinates of a scene from the image 
tapes, exposed at time tj , and displays Images from the two 
spectral bands on the upper and lower parts of the monitor (Fig. 

49) . A search area Is then selected from these data with the 
interactive cursor (Fig. 49). 

When the user has determined size and location of the search area, 
the upper part of the screen is erased and the search areas for 
each spectral band, as well as a video representation of the 
multispectral ratio are displayed (Fig. 52) . The lower part of 
the screen is then erased and the search area data (band 1, band 
2, and multispectral ratio) from the second set of LANDSAT tapes 
(exposed at time tz) is displayed (Fig. 51). The user then 
selects the size and location of a suitable landmark using the 
cursor (Fig. 51), and a box is drawn around the landmark area 
within the search area corresponding to time tz (Fig. 52). 

In an onboard system, selection of the search area would be per- 
formed through algorithms that transform the position and attitude 
of the satellite into size and location of the search area. The 
correlation algorithm described in the previous section is then 
run using the landmark from the multispectral data at time tz and 
the search area from the multispectral data at time t^. A box is 
then drawn around the area of best fit in the search area (Fig. 53) . 
All image data used in the simulation, as well as the correlation 
surface, are available to the user through printouts on the line 
printer. 
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Quantitative results of the advanced VILAT simulation have not 
been obtained because of the delay in delivery of LANDSAT data 
However, preliminary results, in which the multispectral ratio 
was simulated, show that the multispectral ratio will bring 
unique benefits to the registration process. 



Figure 49 Selection of Search Area 
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Figure 50 Display of Search Area 
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Figuee 51 Selection of Landmark Area 
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Figure 62 Display of Landmark Area 
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FiguTe S3 Display Correlation Results 
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VII. 


CONCLUSIONS AND RECOMMENDATIONS 


Remote sensing has traditionally been unselective with respect to 
information content. This has greatly increased data archival 
costs, which are already becoming prohibitive, and has resulted 
in excessive delays between acquisition of the data and its eventual 
dissemination to users. 

Furthermore, technological development of remote sensing systems 
has in many instances outstripped the corresponding development 
of interpretation methodologies and techniques that are essential 
for conversion of remotely sensed data into usable information, 
resulting in a voluminous backlog of raw data. New technologies 
are therefore required to limit the volume of raw data collected 
from satellites, through onboard preprocessing and data identifi- 
cation. 

The activities described in this report have shown that adaptive 
"smart" sensors of this type are feasible and that they can be 
implemented using simple algorithms and a minimum of hardware. 

The techniques described herein should be incorporated in future 
FILE systems to demonstrate their feasibility in an orbital en- 
vironment . 

FILE I, the first such system, is nearing completion and is sched- 
uled to fly in 1980. It will demonstrate autonomous data selec- 
tion and classification of surface features on the basis of their 
spectral signatures through a very simple algorithm. Each of the 
succeeding FILE flights should test more of the techniques and 
capabilities, including autonomous pointing, tracking, correlation, 
and landmark navigation, in a realistic environment. 

Specific recommendations with respect to the next step in the 
development of adaptive sensor systems are as follows. 

1) Breadboard and perform laboratory testing of a cloud detection 
system; 

2) Perform computer simulation studies to evaluate candidate 
concepts for developing a versatile pointing and tracking 
system; 

3) Establish the rationale for a landmark acquisition technique; 

4) Establish a plan oriented toward arriving at the fabrication 
and flight testing of a VILAT instrument with capability for 
acquisition, classification, pointing, tracking, and landmark 
navigation. This plan should contain cost projections, 
flight-test requirements, a development time-line, identifi- 
cation of technology risks, and specific recommendations for 
the next phase of development. Table 8 indicates the sequence 
of experiments that would evolve from the VILAT activity. 
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Table 8 Sample Outline of the VILAT Development Plan 


Shuttle 

Flight 

1980 


1980-81 


1982 


1983 


Experiment Capabilities 

FILE I - OSTA-1 Payload (Current Experiment on 
STS-2 or -3) 

- Classification capability 

- Autonomous real-time operation 

- On-board decision logic 

FILE II (FILE I Modified for Later STS Flight) 

- Classification capability 

- Cloud, snow, and ice discrimination 

- Autonomous real-time operation 

- Enhanced on-board decision logic 

- Shuttle crew interaction capability for 
preselected target data acquisition 

- Ground truth site data acquisition 

FILE III (FILE II Modified) 

- Enhanced classification capability 

- Computational capability 

- Surface interface detection 

- Pointing and tracking capability 

- Shuttle crew Interaction capability 

FILE IV (FILE III Modified) . 

- Enhanced classification capability 

- Computational capability, , 

- Surface interface detection 

- Pointing and tracking capability 

- Area correlation capability 

- Registration and landmark navigation 
capability 

- TM uplink for target data 
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